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ABSTRACT 

The Hofstra Oniversity program in Spied ‘research 
and evaluation in psychology is described as an example of one model 
for training evaluators. The training of psychologists with a 
specialization in evaluation research is reviewed, and the pros and 
cons of evaluation research training within psychoiogy are discussed. 
Several potential benefits of ‘training psychologists in evaluation 
research are presented, such as: (+) the psychologist's professional 
identity ,.remains within a discipline with recognized licensing and 
accreditation procedures; (2) an evaluator trained as a psychologist 
may have a.breader range of marketable skills; and (3) traising in 
evaluation. research may increase the range of career opportunities 


_ for psychologists. One disadvantage of this training concerns the* 


‘potion that evaluation research represents a body of knowledge, which 
transceads any single discipline; the development of 
pbultidisciplinary inpugfs to reflect the contributions of other 
disciplires is suggestgd to overcome this problem. Additionally, 
cther concerns of evaluation research training within psychology are 
addressed, and the Hofstra University program is described in detail. 
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There is an old Islamic tale which te 8 of ShERS blind men who 

» 
beat shits strange beast is ‘tae, 
One of them grabs the’ ‘animal by the ‘eo and cries out that it resembles a- 
large snake. Another topemts nape s oo and informs. the others 


that it is really more like a whale. 


the animal by touching its legs, says thaf\the other two are wrong; the ani- 
; .d 


fo eh, . 
mal is built like the pi (ars of Rome. 7 


These days, evalsators seem & lot, like that elephant in the story. To 


some, the Sipahian cum evaluator should be trained in a core discipline, such 
as PAVENORCEY PEGS OIREYS or social work, with specialized training in sie 
ation reseatch at either predoctoral. or postdoctoral levels. To others, it 
is me Ge take an interdisciplinary approach toward cressane these - ele- 


phangs cum evaluators-to-be. Gondequéntly there is wide diversity of 


P : 
. ° i . ' 
aining programs in evaluation research. These range from masters level 


programs in evaluation, such as at Hahnemann Medical College, “to postdoctoral 


“programs at Northwestern University and the University of California at San 


Francisco, There are interdisciplinary doctoral*prograns which offer evalu- ~ 
ation training, such as the. program in social ecology at the Eatversthy of - 


California at Irvine, and yarious programs which offer course work in evalu- 


ation methods in such areas as urban planning, public administration, public 


health, epidemiology, and e¢ucational research. : 
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The American Psychological Association's graduate school handbook, 


Graduate Study in Psychology 1980-1981 (APA, 1979), lists six doctoral 
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programs in psychology which offer specialization in evaluation research or 


program evaluation. These universities include one in the northeast (Hofstra 


University), three from the midwest (University of Nebraska, Northwestern 


University, and St. Louis University), one from the south (Florida State 


University), and one from the far wést (University of California at 
Berkeley). 

The intent of this paper is not to make a proprietary dnd for suena 
ogy to training rights in evaluation, nor to diminish the value of other 
training models. The fledgling profession of evaluation has yet to reach any 

: ia 
Sdukedeus regarding such issues as training, accreditation, and licensure, 
and the perennial pebbles concerning the designation of roles appropriate to 


ed 
masters and doctoral} flevel practitioners is not any clearer in evaluation 


than in psychology. Rather, the intent of this paper is to contribute to the 


continuing discyssion of the various models of training future evaluators, 
, i j 
and to review/several of the pros and cons of training psychologists in this 


area of specialization at the predoctoral level. As a case in point, the 
) 


Hofstra University program in Applied Research and Evaluation in Psychology 
will be described to provide a concrete example of this training seed.” 
Regarding training at the predoctoral level, it should be noted saeanthers 
cali that evaluation research has been exempt from the mandate.that NIMH 

/ . 
training grant support in the behavioral sciences be shifted from predoctoral 


postdoctoral training. Apparently, the cry that there are too many 


.D.'s "out there" does not yet apply to the developing field of evaluation. 
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Several Pros and Cons of tiaination Research Training Within Psychology 

Séchrest (1976) suggested that psychology represents a natural training 
discipline for ery research, given theyraditional ‘emphasis in psy- . 
chology on research and ivereieaeive weniede: _ Sechrest notes that such 
psychologists agsDonald Campbell have traditionally been’ in the forefront in 

j ie 3 
deve loping alternative research methodologies to apply to field research 
‘problems. While it. is true that evaluators pres are called upon to evaluate 
programs in areas of service which are unfamiliar to them, Sechrest (1976), 
among others, recognizes the value of bringing a Ganketount’ oF information in 
the particular area to bear on the evaluation: teak Sinte mental health is 
perhaps the predominant area for utilization of evaluation, it stands to 
reason that evaluation researchers in mental health receive their training: in 
a behavioral discipline, sich sa: pasehSraws: in which they will be exposed to 
principles which cele program interventions. 

One potential benefit in training psychologists in evaluation research 
is that their professional identity remains within a coreediscipline with its 
own recognized licensing and accreditation procedures. arihbueh — me 
argued that eciaueian teawarch seiveuaie a new etamedan requiring its own 
professional identity and licensing, it remains that mental or physical 


hedith agencies often require training or licensure within a core health re- 
. e 
lated discipline as a prerequisite: for many positions. - While in such states 
ey! ee ORE 
as New York, there has béen.recognition of evaluation research as an 
independent specialty, with career ladders for evaluation specialists and 
examinations in evaluation, this movement toward professionalization on a 


national scale is only in a nascent stage of development (Morell & Flaherty, 


1978). . : 
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Another concern to be recognized is that the pelea Cealsatiee is 


2 


ry 


particularly sensitive tq poletiest changes and budget nonsiderations: While 
the prospects for government support of evaluation srahearch rethain et ehe. in 


oe 
. 


an otherwise sneay fiscal picture for reseasch, , we myst allow for the fact 


that a change in administrative policy could dnverely peEAeecthe suslvation 


marketplace. An evaluator who is trained as a psychologist may, have’ a 


» 


broader range of marketable skills than one trained within a specialized 
. 5 - se . 


degree program in evaluation research. 


‘In the past several years attention has focused on the increasingly 


. 


restrictive employment situation within academia. Astin (1976), for example, 


: —_ 
‘ w ‘ 
in reviewing the future prospects for. psychologists in academia concluded, | 
Pa ; ~— . 
that ". . . the development of new faculty positiogs is not expected to be 
\ . 


anywhete near the rate of new doctorates. ‘According 


© projections, the new 
doctorates will have to find alternates to the t itional academic career 
pursued by doctorate holdess in the past" (p, 76). ‘Evaluation research has 


been recognized as one such innovative career speerbuntes for tomorrow's 
psychologists (Albee, 1976; Wortman, 1977), Alenougt present training models 
in psychology which emphasize laboratory-based experimental research fail to 
equip, students aceecves evaluative skills necessary to conduct meaningful 
evaluation studies in the community (Sechrest, 1976). Similarly, Young and 
Morrow (1980) recognize that while "it is now apparent that the majority of 
Ph.D's in experimental psychology will nies academic position . 


(they) will be forced to seek employment in markets in which they may be 


unready or unable to compete" (p. 122). That is, unless they receive 


specialized training and field experience in evaluation methodologies. 
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Concerning the potential Sp adiancaeen of an evaluation training: nodel 
within atone it must be recognized that eyaluation research represents 
: @ 


a body of knowledge which transcgnds any one discipline. The evaluator 


encounters a research -vocabulary seldom discussed: in traditional psychology 


traiming programs, including such terms as needs assessment, managment 


information systems, cost-benefit analysis, performance measurement, etc. As 


‘“ ‘ 


psychology faculty, we may be responsible for teaching suth material to our 
' F : F 
students, although our ‘own training backgrounds may have been deficient in 


these areas. Of aaieen it might be arguedgthat our professiondl development 
dy 

as faculty should’ Hot have ended with the receipt a our graduat€’ dekrees. 

Many of us have Pereine these evaluation skills through self-development, or 

perhaps through sie 4 sdgbcdapbetat fellowship in evaluation. 


- . . 


However, there is centainly a need for additional continuing education in 


these areas. For instance, the local society of evaluators in the east, the , 


Eastern Evaluation Research Society, sponsors courses in selected evaluation 
~ : 3 
topics for professionals and is developing a more comprehensive continuing 


education program. : ‘<i 
4. . 
Another possibility to increase multidisciplinary input to a training 
program is to involve evaluation practitioners from diverse backgrounds as 


lecturers in special topics in program evaluation seminars. It is also 
possible to arrange for Scakeats to take advanced specialized courses in 
other departments, in computer applications or in cost account iag for 

example, although we should recognize that wniversity departments often tend 
to be covetous of their own student's credit bane. \ 
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It should also be recognized that an evaluation research program may run 


the risk of concentrating too much of its efforts in methodology courses at 


the cost of severely limiting the content courses offered ‘in various areas of,-—~ 
‘ 3 . qe, 
psychology: It is conceivable that doctoral degrees in psychology will be 
. i; a 
1 ' awarded td students who have taken few if any content courses in psychology. 
. - \ a : . 


Such degrees might better be described as degrees in applied methodology or 


evaluation rather than as.degrees in psychology. - In developing. curriculum, - 


it is necessary to consult with state licensing boards and educational i ; , 
accreditating agencies to determine that the program offers the requisite 
numbers of psychology courses in different areas to qualify for psychology . 


; Brees e 
standing, and to qualify its graduates for eligibility for psychology 


licensure. 6 - 


“A major concerp in the develdpment of doctoral studies within psychology 


in the grea of evaluation research is the quality and feasibility of 


” 


dissertation research. Traditional dissertation research in psychology has 
involved testing of theoretjcally relevant predictions of behavior under 


laboratory conditions in which strict experimental controls are possible. In 


- 
/ 


applied settings, however, true experimental designs may not be feasible, or 
‘the dependent variables which can be measured ‘may not adequately test the 
theoretical model. Most field investigations in the evaluation area ba to 
be correlational rather than experimental manipulations, and psychology 
. if 
departments need to examine theit policies which govern dissertation 
research, to insure Giant students can conduct field investigations of 


scientific value, but which may not fit traditional experimental models. “In 


our experience at Hofstra, dissertation students have conducted evaluation- 
. . 


. 


; rd 
related correlational studies, such as examining variables which predict job 
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satisfaction of mental health workers or of inmate's perceptions of the 
social environment of prison treatment settings, or of examining relation- 


ships between length of stay, recidivism, and the clinical course of schizo- 


cr 


phrenia. Other topic areas which are considered fertile ground for disser- , 


tation research include innovative applications and development of new or 


. 


refined evaluation methodologies such as path analysis and time-series - 


. 


analysis. ; 


The Hofstra University Doctoral Program in Applied Research ane Evajpatton 


The purpose of the Hofstra program is to train psychologists for careers 
in research in applied settings. The program offers a Ph.D. in psychology 
with an emphasis on evaluation research. ° The curriculum is structured to 


Oo required courses in several key methodological areas, including 
dousave An research design (experimental and Guaalcguneiaad@alds Sunt wari aes 
statistics, computer programming, multivariate ‘statistics, survey and sam- 
pling techniques, paychometric tmeory, and program evaluation. Required 
content covrses in dayctial ves include learning, psychophysiology, perception 
_ and motivation, commun ity psychology, organizational psychology, current 

si gchoumatent concepts, and social psychology. In addition, in recognition 
of the neéd for evaluation researchers to have a background of fiformadion in 


: ~ , 
the content areas under study (Sechrest, 1976), a two.semester course in 


clinical concepts for evaluation research (introduction to psychological 


assessment techniques and treatment approaches, issues in clinical research, 


etc.) is also required. 
\ 
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The major training device is a five semester research practicum se- 
4 “a 


ae * 
quence, since it is "in the field" where students are challenged to match 


° 


their research skills with the specific problems that arise in applied 


» 


research, such as the frequent difficulty in performing traditional true 


experimental designs. ‘Practicum students are eqpected to spend two days (16 
: * ro 
a 


hours) per.week under professional supervision at the inere ree site for ten 
» : ; - ; 
months each academic year, and also to attend a weekly internship class. In 


this class, experiences and on-site research problems are shared and dis- 
cussed, trainees present and defend their research projects, and receive 


feedback and direction from their supervising faculty members. Through the 


practicum experience, the trainee gains valuable exposure to other important 


facets of evaluation, such:as the politics of evaluation, program planning 


- - 


and budgeting, and ‘perhaps most importantly, learning to effectively interact 


= 


and communicate within a team structure. z, we 

Since the practicum program Rie taden years agS, more than, 60 local 
agencies have participated as placement sites. These agencies have’ included 
mental and physical health een ern social service and criminal justice 
agencies, and business,and institutional settings. At seen. entduls 
mately two thirds of the placements are in the public sector, and one third 


in the priyate sector. Among these public sector agencies are the Pilgrim 


‘and Creedmoor Psychiatric Centers, the Long Island Research Institute, the 


Long Island and the New ‘York City Regional offices of the NYS Office of 


~ > 
Mental peaneEny the NYS Division of Supe EME Abdse Services, North Shore 


University Hospital Department of Neuropsychology, and the. Saf folk 
Developmental Center, among aches; Among the placements’ in the private 
grabs include he American bi hosneal Associations and Surveyss and Audits, 
Inc. : ‘ | 


ly : 
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One of the central problems faced by peychology students as they venture » 


beyond the laboratory into community settings is learning to deal with the 


socio-political realities which affect the evaluation process. Trainees | 
become immediately subject to the pressures of some adminia@dtors and agency 
‘staff to get data which supports ec program's efforts. Thé syaluation 

‘ vesearcher, whether student a professional, often walks the proverbhal thin 
line between the wonaased actanvifie researcher and the public relations 
consultant (Windle. & Neigher, 1978). Learning to anticipate and eeaglve such 
political pressures becomes: a major focus for discussion in the practicum and 


program evaluation,courses. Students learn to perform an "in-loop" assess- 


ment to determine hidden agendas in the agency, and ‘to contract with adminis- 


trators to provide an explicit understanding of their research obligations 


PS ‘ 


and responsibilities. : , , t 


ard 


While research psychologists have traditionally been recrutted to fill 
faculty ranks, the present and abapenbee downturn vx PAGE hiring has led 
. Many research-oriented students to seek alternative career opportunities in 
more applied settings. Evaluation research eneecude one such opportunity™ iS 
4 
particularly when the research student has been provided the opportunity to 
develop evaluation skills ana to suvvigiaus during trdining in supervised 
research projects in field settings. Evaluators have traditionally represen- 
ted a diversity f training backgrounds. It das well be that such@variety in 


_training effortd enriches the evaluation commupity by bringing together 


( 
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professtonals with a wider range of skills and ideas than might be the case . 


if training efforts were more homogenously structured. This paper has 
: fd 


focused on an approach within a department of psychology for training the 


psychologist cum evaluator, and if is hoped that it will further encourage 


discussion of various training models in this developing field. ; . 
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